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The paper describes a sttidy of the scope of geography 
testm^and^he social studies ccifonents of national 
tests, ^The research exailned whether the tests* iteis 
were (1) directed prlBarily toward testirg knowledge at the . 
recali/Beiory level, and (2) coBprehensive in their treatsent of the ^ 
discipline. Ten tests were analyzed, . including ^he 
Hollingsworth^Sanders Geography Test, Icwa lest of Basic Skills 
(ITBSf PorB 6# ^ocial Studies), Michigan EleBentary Gecgraphy Test, 
ahd HCGl interaediate* Level' Geography Test (Draft 2# Parts I, II, 
lll)*^O^ing Bloom's Tai^onoBy, iteBs weie classified by cognitive 
level as testinq knowledge (BeBory) , coBprf faenaicn , afplication, 
analysis, synthesis, or evaluation^ All classificaticns except 
knowledqe (BeBory) were considered to be of a high cognitive levels 
Content m s ca tegori xed as . geographic skills, hUBan gecgraphy, 
physical geography, or ffiiscellaQeous. Results showed that the 
Balority of tests provided a balance between lower and higher 
cognitive questions. However, the Hollingswcrt b^Sanders ccntained no 
higher order questicns - and the ITBS ccttained nc re<all/i€iory iteBs* 
Most tests emphasiEed interpretaticn cf laps, gra-plfi, and charts* 
Only three tests included questions frei 60% or acre cf the content 
categories Included iii the analysis. The NCGI intericdiate Geography 
Test contained the most even spread of test Iteas across content 
tateqories^ (Author/AV) , 
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Over the past several' years many authorVhave stated that achievement 
tests 1n general and the social studies/geography sections -of those tests 
in particular, are not designed to measure intended Instructional outcomes. 
Most often thesT^s^s have been dted as being limited in scope anc^ri- 
marily directed toward testing of knowledge at the recall/memory level. In 
view of the fact that there is a paucity of literature directed specifically 
at geography achievement tests^ or geographic questions containedMn the ^ 
social studies^ components of national achievement tests* this author felt it a 
propriate to carry out an initial analysis of such test items. 

Research Qu estions 

This research effort was designed to answer two main questions: 

1 ) Are test items contained in geographic achievement tests or the 
social studies components of national achievement tests directed primarily 
toward the testing of knowledge at the recall /memory level? 

2) Are test items contained in geographic achievement tests or the^-^ 
social studies components ■ of national achievement tests comprehensive in 
their treatment of the discipline? 

Pr^ocedure 

In brief, the procedure used to gain tentative answers to these questions 
involved devising comprehensive set of cate.0^ries 5 representative of the 
content of geography, by which test items would be classified and the use of 
Bloom's Taxonomy to classify test Items by^. cognitive level. ' 

the categories by which te|t items were classified according to content 
was devised after a thorough review of the recently published work by Maiisorr 
and Vpicich" as well the contents of major uloiiiontary social studies text 

^Gary Manson and Gooi^no Vuicich, Toward Goo^Nipivk Literacy: O^cU^ves^ 
for Geographic Exiucation iji^ the lJ nnuMit^rx (liouTder: ERIC/ChESS and 

SSLCV"1974 ;"' '^^"^"""'^^ " ^^^^ i 




series. An attempt was made to incorporate content found in these" materiaU^ 
as well as to develop categories which were/both* somewhat detaiOed and mutu-. 
ally exclusive. The categorization system finalTy arrived' at i^Vrepresented 
In Tatle I* While the ^prdcedure used to develop the categories ahd even:the 
categories themselves are subject to some question, it is the belief of -the ^ 
author that they are useful for an initial analysis./ \ 

T A B L E ^ ^ I ^ ' ^ ' ' ' / 

^ TEST ITEM CLASSIFIOTION CATEGORIES : .r^ 

A. Geographic Skills < 

1. Recognition and interpretation of scales distance, direption and 
symbol s on maps 

2. Recognition and interpretation , of sca'le, distance, direction and 
symbols on globes 

3. Recognition and Interpretation of graphs and charts. 

4. Inte^retation of photographs and sketches . . 

5. Interpretatio^i of written material , . 

6. Knowledge of terminology related to latitude and^ longitude and use 
^-^—-x^of grid systems to deterniine distance^ direction, location, and time 

7. ^Recognition and use of generic geographic terminology - 

8. / Idenfiflcation and location of specific physical and cultural features 

(pi ace names ) ' - ■ ' . 

9. Recognition of accuracy and distortion in maps 

B. |^uman Geography 

1/ Knowledge of areal association and spatial relationships of land uses 

2. ^Knowledge of cultural patterns &nd processes 

3. 'Knowledge of ^association of cultural patterns and/or economic endeavors 

with pol i tical -cul tural and/or physical regions 

4. Knowledge of the economic and/or pol i ti cal impl Icatfons of spatial 
distribution and location of phenomena 

5. Recognition and use of terminology specifically related to human geography 

C. Physical Geography ^ - , 

# 

1. KnowTedge of [ifiysical processes, i.e., erosion, aggradation, etc, 

2. KnowTedge of eat^th^sun relations, incTuding motion, position, time, 
and' s'^easons ^' ^ 
Knowledge of spatial distribution and area! association o^^climatic. 



3, 
4, 
5, 



vegetativG, and gooiiiorphol oy i c phononiQna 

Recognition and use of tenninology specifically related^to physical 
geography / ' 

Knowlocic^Q of the size and shape ofi^ the earth 

/ 

Mi sccl 1 anoous 1 torfis 



ERIC 



' NG. Non-gcngrti|)hic items 



' Cla^^sificatton of items by cognitive lev^el was performed tHrgugh the^ 
use of ^loom^ Taxonomy as represented in Table II. A decision ms made to 
' classl^ the ItemSi/as either lower cognitive level (recall/memory) or higher 
cognitive level- IcQmprehension through eva1u^.tion) . 

- / ■ • J A B L E 'l I ■ . . ' 

/ TAXONOMY OF £DPCATIOMAL OBJECTIVES- ' COGrtniVE DOMAIJi^ ^ X 

I, Knowledge (Memory) Ability to recall, lo bring to^mind ^ 

, - appropriate materiai* ^ ^ * 

Tl.. Comprehension . ' Ability to know w^hat is being communi- 

cated and to be ^ble to make 'some use ^ 
of the^materlals or ideas contained 
1n ttV ^\ ^ . 

III. ApRlicatlon : Abyity to use ideas, principles, 

: - ^ and gfeneral izations tn new situations . 



IV. Analysis ^ = Ability to identifyUhe component parts 

\ ■ . . . of &n Idea and to establish the logical 

relationships of the parts of the whole. 



Synthesfs Ability to draw on elements* frfim many 

sources and put these together into a 
structure not clearT> there previously. 



VI ^ Eval uatnon "Ability to make a judgment about the 

value I for some purpose i of ideas or * 
^ = ^ * prdcedures I- soTuti ons , -methods 5 materials 

Selection of tests to be analyzed was made on two bases: 1) tests 
were either strictly devoted to assessing geographic knowledge at the inter- 
mediate^ level, i^grades S-8/9), or 2) tests were widely used national achieve- 
ment batteries 'for the i nternii^diate level which contai-ned social studies 
components-. Tests selected are r^epresentati ve of thosfe available, |3ut no- 
attempt was madG at inclusion of all such tests. RefGrences to the tests 
which were analyzed is contained 'fn the Appendix, 



Findings ' 



^ . F1rid,ings/of the study are shown 1n Table III, IV, and V. 

- Discussidn^ 

. ^ In reference to the first research question, .the majority of the tests 
provided a balance of questions between the lower and higher cognitive ques- 
tions (see Table V^j Column 1), Th6 exceptions were the Hollingsworth=Sanders 
wh^ich contained no higher order questions arid the Iowa Test of Basic Sk11>s 
which contained no questions at the recall/memory level. . 

because It was found that the majority of tests emphasized interpreta- 
tion of maps, graphs, and charts; and because by definition those items are 
higher order questions; it was dec1ded'''to furt|;ier analyze the items excluding 
categories and A^. The results irrdicated that only five of the ^sts 
still provided a balance of lower and higher order questions, with the ^ 
Brandywine and the NCGE Intermediate including a majority of higher order 
questions (see Table V, Column 2). . 

In regard to the second research question, it was found that only three 
tests 1 ncl uded questions from SOS or more of the content categories included 
In the analysis. These were the Map & Globe Skills Diagnostic Test, the 
hH^^gan Elenientary Geography Tests and the NCGE Intermediate Geography 
Test (see table V, Column 3), Of the three which included 60% or more of 
the content ^categories s the NCGE Intermediate Geography Test contained the 
most even spread of test it^ms across the three main content areas: skills, 
human geography , and physical geography. ^ . . 

ConclusiOfis and Reconiinendatioris ' 



In regard to tfioso cM^acteri sties desired in achievement tests by pro- 
fessional gGographic QduGBtors, those tests analyzed in this study deserve 



neither total condemnation nor unqucalified praise* Further work needs to . 
be done to modify and/or develop tests which are comprehensive in rB-ture 
and which, provide a balance between Icwer and higher order questions. The 
jlCGE Intermediate Level Geography Test probably represents the best progress 
toward this goal to date. 
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CLASSIFICATION OF^TEST ITEMS 
BY CtoT'ANDCQilTIVE LEVEL ■ 
(A^sol-ute.^ymbars)' 



Test 
Name 



Srandywine 
Achiivement 
Test in Geo", 
for Sec. Sch 
Srades M2 



Honingsworth 
Sanders |eo. 
Test, Test 1, 
Form A 
irides 5^7 



Iowa Test of 
Basic Skills, 
Forni 6, Soc, 
Studies' 
Srades 4-9 



%p i Globe 
skills Diag 
lostic Test 
trades 3-9 




topolitan 1 
Achievement ' 
[est. F^mF, 93 



JUL' 



SKILLS. 



Test 

Name 



^1 



I of 
IteoiS 



C09. 
Level 



^6. 



If 



Hfitpopolitan 1 
Aehieveoiint. 
Test, Fori F 
Social Studies 
Grades ? - 9.6. 



94 



12 



12 



Hlchip Elem. 
Giog. -Tist 
trades 5-8 



50 



IG 



ERA Achievement , 
Tfst, Form E 
Social Studies 40 
Grades 4-9 



J 



Stanford Achieve- 
ment Tests 
Fonn A, Soc. §0 
Studies 
Gradef|«E'8 



NCGE Inter- ' 
mediate Level 
Geog.'lest 



aa 



16 



10 



10 



f 



■ ' ^. UBLE IV 
. , CLASSIEICAlIp^ OF TEST ITETIS 
^. |6yCtar.iDC0ifTIl/ELEyEL; 
• 5 ,[ ' (Pei-centages) ■ 

mm'' \ ' , 



PHYSICAL 



■ ' ■ ■ m 

Tilt 'I of f^i. 



iieveiiient 
for Ssc/Sch. 



lollingsworth- 
ianders Geo. 
"est, Test i, 
■orni If i 
i|^des 5-7 



•65 



* 



Iowa Telt oi . 
lasic Skil W''^"'" 
'Oriii 6, Soc— ^84 
itudies 
irades .4-9 



lap h Globe 
iMlh-,Oiag- 
iostic Test 
Irades 3-f 



31/] 



letropoTitan 
Ichievement , 
'est, Form F 



ii.e 



93 



1 r,c 



15. 



3M 



J.5? 



3.S 



11.3 



3,oe 



lii 



?1.5 



50.' 



T A B L E y 
^ASSIFICATIOf^ OF TEST ITEMS: SUMMJABLE; 



Cog, Level 
w/o A] U3 , 
Lo Hi 



Categories (]uestic[ns QjuestionsHOuestions 
[Represented from ' - from > from « 
■ .| Area A W] Area B (I) Area C «) 



33' 87 66, 



50.01 



.35 



E9.03 



IGO.OO 



45.01 • 40.00 



30.77 



7.69 



35. 



8.33 4.76 



70.2] 



,79 ' 50.01 



73.90 , 1.45 ^ 24.64 

* 1 



.00/ 



50,01 63.04 13.04 23. 9| 



30.01 '71,43 28.57 



52.94 47,05 5 



5.01 . ' '66.00 16. [ 



.00 



73.91 25.09 45.01 57,74 25.81 5.45 



86.2] ' 13. J9 55. or, 41.03 53.85 5.13 



33,90 ' 65.10 55.01 50.59 27.06 22.35 



A P P E D I X 
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NAME 

Brandywine Achiovcnient Tost 
in Geography for Secir 
.Schools, Form A^ Parts I 
"and II r ^ 

Hoi 1 i ngsworth^Sriiulers 
Geography Test 



lowr Tost of Basic 
SkiTls Fo™ 6, ^ 
Social Studies 

Map and Globe Skills 
Diagnostic Test 

Metropolitan Achievenient. 
Test 



Metropolitan Achieveiftent 
Test, Fom F, Social 
Studies 



GRADEJ^EV^ 
7-12 



Michigan Elermantary 
Geography Test 

? 

SRA Achieyement Series , 
Form E, Social Stuciicis 

Stanford Achievenient Test, 
Form A, Social Studies 



NCGE Interniediatc Level 
Geography Test, Draft 2, 
Parts I , II . Ill 



5 = 7 

4=9 

3-9 
5.0-6.9 

7.0=9.5 

5=8 

5-8 
5-8 



Coatesvi lie, Pa . : 
Branclywine Ach. 
Test / 1 962. 



Ernijori a , Kansas ; 

EmjDO r i a State U ii i ve r s i ty , 

1964. 

Geneva, Illinois: 
Hougli ton -M iff! i n , ^ 
1971. (, 

I 

Chicacjn: jA.J. Nystroni, 



1974 



New York: llarcourtj 
B ra ce 5 a n d Jo va no v i c h , 
1 970 = 

Nev/ Yoii:: Harcourt, 
Brace, and Jovanovich, 
1970/ 



Lansing: Dept, of 
G e 0 g r a [:) liy , M i c li i g a n 
State University, 1974. 

Chicago; SRA, 1971 



New York: Harcourt, 
Brace, and Jovanovich, 
1 972. 

Houston: liCGE, 1 978. 



